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Abstract 

We revisit the design space of visualizations aiming at 
identifying and relating its components. In this sense, 
we establish a model to examine the process through 
which visualizations become expressive for users. This 
model has leaded us to a taxonomy oriented to the 
human visual perception, a conceptualization that 
provides natural criteria in order to delineate a novel 
understanding for the visualization design space. The 
new organization of concepts that we introduce is our 
main contribution: a grammar for the visualization 
design based on the review of former works and of 
classical and state-of-the-art techniques. Like so, 
the paper is presented as a survey whose structure 
introduces a new conceptualization for the space of 
techniques concerning visual analysis. 

keywords: Information Visualization, Taxonomy, 

Design Space, Visualization Model 


1 Introduction and Related Work 

Research on data visualization aims at providing im¬ 
proved mechanisms for information exploration and 
analysis, offering faster and friendlier - if compared to 
traditional analytical approaches - techniques to assist 
on data comprehension. This is possible because an an¬ 
alyst can, with reduced effort, improve his/her under¬ 


standings of a dataset when interacting through graphi¬ 
cal representations. 

Visualization, as it occurs with any research field, will 
benefit from a conceptual framework to organize meth¬ 
ods and techniques in a unified comprehension space, 
i.e., a delimited space of possibilities where one can 
navigate through the constituent variables without loos¬ 
ing her/his referential locus. Following this assumption, 
recent highly relevant publications about the next steps 
for visualization research have addressed the importance 
of the topics dealt in the present work. Thomas and 
Cook iHSl, recommend the need to “Conduct research 
to formally define the design spaces that capture differ¬ 
ent classes of visualizations”; Johnson et al. f23\ state, 
among their long term recommendations, the need to 
systematically explore the design space of visual repre¬ 
sentations; and Chaomei observes the need to under¬ 
stand elementary perceptual-cognitive tasks based on a 
substantial amount of empirical evidence. 

Several works in the literature have sought to accom¬ 
plish such task, either from an analytical or from a taxo- 
nomical perspective. The analytical approaches listed in 
Table [^a) strive to empirically identify the ultimate el¬ 
ements of visualizations and to draw their relationship. 
Bertin Ol presents eight visual variables: the two pla¬ 
nar dimensions x and y plus six retinal variables: size, 
value, grain, color, orientation, and shape. Cleveland 
and McGill lITTIl and Mackinlay lf35l define, in order to 
support automatic design, empirical studies over simple 
data visualization aiming at stating the usefulness of spe- 
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cific visual patterns. Card, Mackinlay and Shneiderman 
Q follow the theories of Bertin introducing concepts 
about the importance of the spatial substrate and how 
it can be used. 

Taxonomical approaches, listed in Table [^b), aim at 
empirically identifying common characteristics pertain¬ 
ing to existing visualization techniques, in order to pro¬ 
pose class-oriented organizations. Keim ll^ concen¬ 
trates on high-level visual patterns in order to define a 
space of possibilities intuitive for users. Shneiderman 
[1471 focuses on the possible combinations of visualiza¬ 
tion practices and interaction. Chi ifTOll describes visu¬ 
alization techniques focusing on data and its transfor¬ 
mations. Meanwhile, we focus on organizing the visual 
features of design from a cognitive perspective. Buga- 
jska |l5l thoroughly treats the topic of spatial design for 
abstract visualization proposing a holistic approach in 
sharing expertise among visual design, computer sci¬ 
ence, and social fields of study. Tweedie ll50ll suggests 
a number of recommendations for design in a work ori¬ 
ented to guidelines. 

Former analytical and taxonomical approaches focus 
mainly on high-level components of visualizations: data 
types, visual patterns, visual appearance, user tasks and 
interaction mechanisms. These works brought signifi¬ 
cant contribution to visualization design and understand¬ 
ing, but they have overlooked the process through which 
visualizations become expressive for users. This process 
relates to how data translates into visual stimuli and to 
how these stimuli translates into reasoning. Our claim in 
the present work is that the consideration of this particu¬ 
lar process contributes to a better understanding of visual 
data presentations. With this consideration in mind, we 
organize the space of visualizations both taxonomically 
and analytically (design space definition) in a scenario 
driven by the process of visually expressing information. 

We observe that, distinctly from works that focus on 
design guidelines, analytical works focusing on design 
space theories aim at providing a better organization of 
concepts so that design-related activities can be better 
engendered. In this context, our work defines a design 
space in order to introduce a new conceptual structure, 
a grammar, related to the domain of design possibilities. 
On the other hand, regarding the important topic of de¬ 
sign guidelines, MacEachren |[34ll presents a complete 
book that extensively reviews methods for data presen¬ 
tation at the same time that he evaluates their adequacy 
and utilization. His work, a rich review of practices for 
data visual presentation, is a cornerstone reference for 
visualization design. MacEachren states that the mean¬ 


ing of a map is not absolute but a product of the society 
and its culture. He also states that the way information 
is mentally represented determines how groups and soci¬ 
eties can develop a consensus about data representation. 
This consensus, in the realm of data visualization, is the 
object of the theoretical and empirical investigation that 
supports our work. 

In the sphere of design space theories, our initial con¬ 
siderations are based on the work by Card et al Id, 
who identify the elements of visualizations. Card et al 
starts from the assumption that visualizations are limited 
to the spatial substrate, to marks and to graphical prop¬ 
erties pertaining to these marks. Such graphical prop¬ 
erties are what Bertin [3] defines as retinal properties. 
Ware [39] distinguishes the retinal properties proposed 
by Bertin as visual patterns defined either by shape or 
by color. In line with these former studies, we consider 
visualizations as being composed of three fundamental 
components: position, shape and color. Each of these 
components conveys visual perceptual cues, which we 
refer to as visual perceptions. The observation of these 
phenomena is formalized in a model named Visual Ex¬ 
pression Process, which grounds this work. 

The remaining of this paper is organized as follows. 
Section introduces the fundamentals of this work, 
presents the Visual Expression Process, and delineates 
our research line. Section guides our initial ideas by 
proposing the Spatial-Perceptual Taxonomy. Section 
exemplifies our ideas and discusses further possibilities, 
while section delineates the Spatial-Perceptual De¬ 
sign Space. Section explains the role of interaction 
in the proposed framework. Sectionj^proposes a unified 
model for visualization, named Visualization Machine, 
which integrates all the proposed concepts. Section 
presents the concluding remarks. 

2 Fundamentals 

In the present work we define two levels of abstrac¬ 
tion for the practice of visualization: design of visual¬ 
ization techniques and design of visualization systems. 
While the design of techniques is concerned to how a 
visual representation should be structured and look like, 
the design of visualization systems is also concerned to 
the aspects of data processing and interaction. We em¬ 
phasize that in the discussion that follows, the scope of 
this work applies essentially to the topic of visualization 
techniques. Nevertheless, for the sake of completeness, 
we touch the topic of visualization systems (processing 
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+ visualization + interaction) discussing how and where 
our theory relates to systematization. In this section, ini¬ 
tially, we introduce the underlying knowledge and the 
basic definitions central to the development of our ideas. 


2.1 Semiotics and Pre-attentive Visual Stimuli 

Semiotic Theory, from Vision Science, is the study of 
signs and their ability to convey meaning. According 
to this theory, the visual process comprises two phases, 
namely, the parallel extraction of low-level properties 
(called pre-attentive processing), followed by a slower 
detailed scan. The first phase, pre-attentive processing, 
plays a crucial role in promoting the major benefit of 
visualizations, that is, improved and faster data compre¬ 
hension [i49l. Meanwhile, the second phase addresses 
conventional reading practices that do not contribute to¬ 
wards faster visual cognition. In this sense. Ware states 
that understanding what is processed pre-attentively, see 
Figure is probably the most important contribution 
that Vision Science can bring to data visualization ll52l . 

Pre-attentive processing refers to whatever can be vi¬ 
sually identified through unconscious processes. As 
such, it determines which visual objects are instantly and 
effortlessly brought to our attention. As depicted in fig¬ 
ure]^ Ware [39] identifies the categories of visual fea¬ 
tures that are pre-attentively processed. His study con¬ 
siders Position, Shape and Color - besides the animation 
of each of these three factors. According to Pylyshyn 
et al. HOll , there are specialized areas of the brain to 
process each of these stimuli. Actually, the position- 
shape-color perception is true for everything we see. At 
any moment and for anything on which we focus our 
eyes, we can ask three questions: where is it? what is its 
shape? and what color is it? 

For visualizations to be effective, they must build on 
pre-attentive features in order to maximize the num¬ 
ber of just noticeable differences. In fact, although vi¬ 
sual processes are not limited to pre-attention, visualiza¬ 
tion design is supposedly oriented to maximize design- 
specific pre-attentive effects. That is, there are many 
graphical properties, but just a limited number of them 
can be used for visual analysis Q. Accordingly, in this 
research we assume that visualizations are composed of 
features that are potentially or desirably pre-attentive. 

Following this conception, pre-attention effectiveness 
may vary, or even be absent, depending on the data and 
on the particular design. 


2.2 Spatialization and Position 

According to Gattis HU, for a visualization to be ef¬ 
fective, organization plays an important role. In order 
to achieve such organization, the spatial schemas (spa- 
tializations) are the main graphic representation. Data 
spatialization refers to its transformation into a visi¬ 
ble/spatial format. Straightly, it is possible to conclude 
that the spatial positioning, dictated by the spatializa¬ 
tion process, is what promotes positional pre-attention. 
In their state-of-the-art work. Card et al. 0 refer to 
the spatial substrate as the most fundamental aspect of 
a visual structure, being the first decision in the visu¬ 
alization design. In fact, Rohrer et al. state that 
visualizing the non-visual requires mapping the abstract 
into a physical form. Rhyne et al. [l42l distinguishes Sci¬ 
entific visualization and Information visualization based 
on whether the spatialization mechanism is given or cho¬ 
sen, respectively. Spatialization is the fundamental ele¬ 
ment to enable the visual data analysis, at the same time 
that it dictates the characteristics of the pre-attentive po¬ 
sitional perception. Indeed, positional expressiveness 
depends on a mapping function that drives data elements 
into spatial positions. 

2.3 The Visual Expression Process 

The Visual Expression Process is a scheme of how 
visualizations improve useful knowledge acquisition. 
The diagram in Figure [^describes a process that departs 
from pre-attentive visual stimuli - the presence of a 
dataset is naturally assumed - and culminates in data 
interpretation. The key elements of such process are: 
the pre-attentive stimuli used to conceive visualizations, 
the concept of visual perception, and the interpretation 
factor. The model is now examined in order to grasp its 
structure, in search for a new strategy for visualization 
science. 


Pre-attentive stimuli and visual patterns 

Our initial assumption is that a visualization is com¬ 
posed of the three pre-attentive stimuli - position, shape 
and color - presented in section 7^ and depicted at the 
left-hand side of Figure For each of them, a set of 
visual patterns may be employed for the visualization 
design. Such patterns include (but are not limited to): 


• position: 1D/2D/3D position, stereoscopic depth; 

• shape: line, area, volume, form, orientation, length, 
width, collinearity, size, curvature, marks, nu- 
merosity, convex/concave; 
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Figure 1: Example of pre-attention. Identifying the number of “4” symbols (22 in total) is easier when the symbols 
are emphasized (b), than when they are not (a). Adapted from Ware i52\ . 
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Figure 2: Pre-attentive visual stimuli. 


• color: hue, saturation, brightness. 

Visual perceptions 

Visual perceptions designate the limited number of user- 
related phenomena that are fired by the pre-attentive 
stimuli composing a visual presentation. Visual percep¬ 
tions are understood as the recognition of visual stim¬ 
uli chiefly based on the memory of the user who ob¬ 
serves the scene. They are observable even if she/he has 
no knowledge about the underlying data and, therefore, 
they are an inherent component of the visualization prac¬ 
tice. 

Visual perceptions seem to be the natural features that 
any user tries to identify when interpreting a visualiza¬ 
tion scene. If they are not found by the user, the pipeline 
outlined in Figure]^ is broken and the visual expression 
process is interrupted. Due to their importance, we have 
extensively surveyed the occurrence of visual percep¬ 
tions in visualization literature. We found a limited set 
and, by empirical observation, we verified that this set is 
recurrent in visualization techniques. We also observed 
that each visual perception is fired by one or multiple 
pre-attentive stimuli, having either a discrete or continu¬ 
ous nature. 

In the work by Bertin (O, and also observed by 
Bowman in and Card 0, one can identify two oc¬ 
currences of visual perceptions: extended expression 
(which we call correspondence) and differentiation of 
marks. Mackinlay l[35l states that the perception of 
relationships comes from visual patterns that remind 
of the notion of connectivity. Besides these three vi¬ 


sual perceptions, namely correspondence, differentia¬ 
tion and connectivity, we also identified: arrangement, 
for perceptions that arise from group positional config¬ 
urations (Gestalt principles OOl ): and meaning, for per¬ 
ceptions that draw on resemblance with previous knowl¬ 
edge and/or expertise. The list of visual perceptions we 
have identified includes, but it is not limited to: 

• correspondence: Each position/shape/color estab¬ 
lishes a distinct correspondence with respect to 
some referential map. The need for an explicit 
visual map or for an implicit mental map is as¬ 
sumed. Examples of visual maps include axes, ge¬ 
ographical maps, shape/color dictionaries and po¬ 
sition/shape/color variation ranges. Examples of 
mental maps include known orderings and shape 
metaphors; 

• differentiation: Each position/shape/color discrim¬ 
inates one or more graphical items. Differentiation 
is the simplest visual perception and can be under¬ 
stood as a kind of correspondence in which the user 
creates a temporary mental map in memory; 

• connectivity: Shapes that convey information about 
relationships; 

• arrangement: Gestalt principles of organization 
[Koffka, 1935]. Positional placements (similar¬ 
ity, continuity, closure, proximity, symmetry and 
figure/background) that convey information about 
group properties, e.g. clusters and structural cues; 

• meaning: Positions/shapes/colors whose inter¬ 
pretation relies on the expertise of the user or on 
previous knowledge. Meaning can be understood 
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Figure 3: The visual expression process. 


as a kind of correspondence established from 
visual entities to concepts retained in the long 
term memory of the user. Something is perceived 
as meaningful if its significance extends beyond 
the context of the visualization. In contrast, the 
components of a data visualization scene become 
significant due to their own ensemble. 

Other visual perceptions could possibly be identified, 
as for example, textual labels, textures, and enclosure, 
as proposed by Mackinlay |[35l . However, we do 
not include them in the above list. Textual labels 
may be considered compositions of shapes expressing 
perceptions of meaning or differentiation. As for 
textures, Kimchi ||2^ reviews the literature of Vision 
Science stating that textures have been interpreted as 
similarity-based groupings of shapes. For the visual¬ 
ization science, textures are somewhat at the boundary 
between shape expression (the individuation of the 
shapes in the texture) and color expression (the grouped 
shapes). Typically, two perceptions rise: correspon¬ 
dence/differentiation (like color expressiveness) or 
meaningful resemblance to a known material surface 
(like shape expressiveness). 

Interpretations 

Interpretations refer to conclusions, inferences or deduc¬ 


tions produced with the aid of the visualization scene in 
conjunction with the knowledge of the data domain. As 
depicted in Figure the user interpretation of a given 
visualization occurs as a consequence of her/his visual 
perception. A data visualization may be more or less ef¬ 
fective in providing proper interpretations, it depends on 
the data, on the visualization itself and on the user. Our 
understanding is that the interpretations include, but are 
not limited to the following list of concepts: correlation, 
tendency, classification, relationship, summarization, 
outlier, cluster, structure and reading. 

The visual expression process 

Figure aggregates the observations made so far into a 
single process, named Visual Expression Process. Three 
cognitive tasks are involved in this process: conception, 
observation and reasoning. Designing a visualization re¬ 
quires establishing how position, shape and color will be 
employed for visual stimulation; during observation, vi¬ 
sualizations (properly designed) necessarily provide vi¬ 
sual perceptions; user reasoning, based on the visual per¬ 
ceptions, may or may not induce interpretations about 
the data. 

Our view is that the Visual Expression Process is the 
underlying process behind all visualization techniques. 
Intuitively, one can say that the visual patterns of posi¬ 
tion, shape and color are purely related to the raw data 
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and that, through visual perception, interpretations can 
be stimulated. The interpretations, in turn, are related 
not to data, but to new information in the context of the 
application domain. In other words, interpretation leads 
to knowledge. 

The Visual Expression Process establishes that, once 
a visualization is conceived, two additional steps are re¬ 
quired prior to achieving knowledge generation: obser¬ 
vation and reasoning. However, a gap separates visual¬ 
izations from their interpretation. This gap is filled by 
the concept of Visual Perception, which relies on the 
user memory in order to transform observations into pro¬ 
cedures related to the science of analytical reasoning 
||48l, and to knowledge. In this work we identify how 
the Visual Expression Process establishes key issues for 
visualization research: what are the elements of visual¬ 
ization techniques? how such elements can be used in 
order to define analytical visual perception? what factor 
bridges visual stimulation and knowledge production? 

The foundations and argumentations we develop in 
this work apply to empirical observations related to 
vision processes seeking to maximize the perception for 
data exploration and, as such, they are restricted to the 
science of Data Visualization - we do not claim that 
they apply to vision science in general. 


2.4 Research Line 

The Visual Expression Process presented in the former 
section establishes that, given a visualization, two steps 
are required to produce knowledge: observation of vi¬ 
sual stimuli and reasoning. Between these two steps 
there is a gap separating visualizations from interpreta¬ 
tions. This gap is fulfilled with the concept of Visual 
Perceptions. 

Our thesis is that it is possible to deploy a taxonomical 
and analytical theory that, while based on visual stimuli, 
is oriented to visual perceptions. This choice is justified 
by the observed properties of Visual Perceptions, that: 

• Are common to every visualization, in contrast to 
interpretations; 

• Are not numerous, in contrast to visual patterns; 

• Can be categorically related to the pre-attentive 
stimuli, allowing for immediate recognition and as¬ 
sociation; 

• Constitute a key element for visual analytical cog¬ 
nition. 


These features suggest that a perceptions-oriented- 
study can be more rational than former works mainly 
oriented to visual patterns (see Section [^. That is, it 
is easier to know which interpretations can be achieved 
from a given perception than from a given visual pat¬ 
tern. Our point is that it is possible to break a visual¬ 
ization into distinct parts: pre-attentive stimulli of posi¬ 
tion (spatialization), color and shape that, in turn, derive 
visual perceptions of correspondence, connectivity, dif¬ 
ferentiation, arrangement and meaning. We believe that 
this analytical course can provide a simpler control of 
which visual effects are effective, and for what. We use 
this notion in order to review the visualization science 
from a non-holist perspective. 

The goal of this work is to introduce an alternative 
organization of concepts, a platform for comprehension 
and for discrete analysis of visualization techniques. 
In this sense, the paper starts with the description of a 
taxonomy that identifies the features that characterize 
visualization techniques. These features are, then, 
represented in a space of design possibilities where 
each set of points corresponds to a taxonomical class. 
Complementing our theorization, we introduce an ideal 
model for navigating the design possibilities predicted 
by our theory. 


2.5 Contributions 

To state the contributions of this work, we compare its 
principles with the work by Card et al 111, which is 
the most cited proposition for the topic of visualization 
design space. Compared to Card et al we make the 
following observations: 

• Distinctly from Card et al and from most of prior 
theories, our work is not centered on visual pat¬ 
terns (retinal properties) whose number and diver¬ 
sity raise difficulties for a clear and general analyti¬ 
cal view of a given visualization. Instead, we argue 
that a user is more interested on the visual percep¬ 
tions that she/he can benefit of than on the visual 
patterns that she/he can use. Eor example, instead 
of desiring a set of axes and points, a user would 
be more interested in observing properties of corre¬ 
spondence that are present (or not) in the data; 

• Card et al affirm that the space can be con¬ 
figured through techniques of composition, align¬ 
ment, folding, recursion and overloading. These 
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items reveals that, instead of defining a general un¬ 
derstanding, the authors tried to exhaustively list 
the different ways that the space can be occupied 
in visualization design. This lack of generality pre¬ 
vents the analyses of techniques such as the Star 
Glyphs and Visimpact ||2T1. Differently, we intro¬ 
duce an alternative comprehension for space uti¬ 
lization, which is closely related to spatialization 
and to gradual occupation; 

• In the same way as for spatial design, interaction is 
not part of Card et al theory (nor of many prior the¬ 
ories). Instead, the authors state an exhaustive list 
of observable interactive practices. In their work 
there is no relation between the visualization ele¬ 
ments and the interaction practices that they iden¬ 
tify. In a more general way, our proposition states 
that interaction mechanisms are natural ways to al¬ 
ter the parameters of the pre-attentive components 
present in any visualization. 

3 The Spatial-Perceptual Taxonomy 

Classification serves as an instrument for the struc¬ 
tured development of new guidelines, as well as to or¬ 
ganize the existing ones [Q. Like so, the objective 
of the following taxonomical study is to improve the 
comprehension of what are the components of visual¬ 
izations and how to classify such components from a 
cognitive/perceptual perspective. Rather than focusing 
on specific visualization cases, the discussion fosters 
a comprehension for the analytical appreciation of the 
overall visualization practice, independent of usability 
or adequacy. 

We start our taxonomy by discussing spatialization. 
In the next sections we discuss how shape and color are 
employed by visualization techniques. 

3.1 Spatialization 

Based on the notion of spatialization, we have verified 
that visualization techniques can be grouped according 
to how they are spatialized. We have identified the fol¬ 
lowing classes for the criterion of spatialization: Struc¬ 
ture Exposition, Sequencing, Projection and Reproduc¬ 
tion. 

• Structure exposition: data can embed intrinsic struc¬ 
tures, such as hierarchies or relationship networks 
(graph-like), that embody a considerable part of the data 


meaning. We designate as Structure Exposition the tech¬ 
niques aiming at exposing the data structure. Such tech¬ 
niques rely on methods to adjust the data presentation 
so that the underlying structure can be visually noticed. 
They are usually domain specific and attempt to maxi¬ 
mize the perception of arrangement. Examples include 
the TreeMap technique (hierarchical recursive po¬ 
sitioning), illustrated in Eigure|^a), and force-directed 
graph layouts IITtII (iterative positioning), illustrated in 
Eiguregb); 

• Sequencing: is the simplest positioning procedure. It 
works by placing the dataset in a sequential arrange¬ 
ment, typically following the overall equation: 

(^Z + l 5 2/z+l 7 ^Z+l) — (1) 

that is, the position occupied by a particular data item 
only depends on the position of the preceding item. Se¬ 
quential spatializations adopt linear, circular or more 
elaborated positioning patterns (arrangements) that con¬ 
stitute the positional mapping of the visualization. These 
arrangements can fire visual perceptions of differenti¬ 
ation or correspondence. Differentiation is intrinsic to 
position, while correspondence is achieved when a map 
is provided. Sequential spatializations typically adopt 
mental or visual positional maps. Mental mappings are 
based on a declared order, as illustrated in Eigurej^a). 
Visual mappings are based on a positional map that ex¬ 
plicitly identifies each position, as illustrated in Eigure 
|5l:b). 

Sequential positioning techniques tend to fully popu¬ 
late the display area and some of them are referred to 
as dense pixel displays. The pixel-oriented techniques 
proposed by Keim are well-known examples of se¬ 
quential positioning. They use just color and no shape 
encoding to present the data items, which are positioned 
according to elaborated sequential patterns l[27]l . Pixel 
Bar Charts ll28]l is a variation of such techniques, it re¬ 
lies on two spatialization cycles in order to benefit from 
size encoding. 

• Projection: stands for a data display modeled by func¬ 
tional variables. The position of a data item is defined 
by a mathematical function (either explicit or implicit) 
that generates a set of positional marks representing the 
data. The marks state perception of correspondence to 
the axes used as positional maps. At the same time, the 
discrete set of positional marks can compose, via im¬ 
plicit or explicit interpolation, lines, areas, surfaces or 
volumes that induce perception meaning. An axial ref¬ 
erence is required for spatializations based on projection 
that, in general, take the format: 
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Figure 4: (a) TreeMap structure exposition. Position: hierarchical arrangement; shape: continuous correspondence 
(size proportionality); color: discrete differentiation, (b) Force-directed structure exposition. Position: relational 
arrangement; shape: connection lines and meaningful arrows; color: discrete differentiation. 



Figure 5: (a) Pixel Bar Charts - each pixel maps sequentially one manufacturer transaction. Position: discrete cor¬ 
respondence to the map of labels that identify the manufacturers positioned in horizontal sequence, and continuous 
correspondence of the transactions (pixels) to the sequential mental map following the ascending time order de¬ 
clared over the scene; shape: continuous correspondence (width); color: continuous correspondence, (b) Pie chart 
sequencing. Position: discrete correspondence to the non-ordered circular sequence of labels; shape: continuous 
correspondence (area); color: discrete differentiation. 


^i) /(^(i,0) 5 5 • • • 5 1)) (^) 

where di^j is the j—th attribute of the i—th data item and 
n is the dataset dimensionality. Examples include Par¬ 
allel Coordinates (one projection per data dimension), 
conventional plots and Star Coordinates ll24ll . as illus¬ 
trated in Figures l^a) and[^b); 

There is a well-defined boundary between spatializa- 
tions based on projection and those based on sequencing. 
Projections are sequences strictly limited to quantitative 
data and that have been restricted to positional maps in 
the format of axes. Sequencings apply primarily to nom¬ 
inal and ordinal data and may have arbitrary positional 
maps. Hybrid variations exist that benefit from both spa- 
tializations simultaneously, as discussed further. 


• Reproduction: data positioning is known beforehand, 
having been determined by the original spatialization of 
the system/phenomenon that generated the data. Ideally, 
the visualization and the observed phenomenon should 
define: 

{x\y\z') = S{x,y,z) (3) 

where 5 is a function that takes as input a set of real 
world coordinates and outputs 3D projection coor¬ 
dinates. Figure illustrates two examples. Usually, 
specific algorithms lITSll are required to identify the data 
positioning based on the implicit physical structure of 
the data. Other algorithms may be employed to simplify 
intractable volumes and/or to derive additional features 
represented as colors, glyphs or streamlines. Reproduc- 
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3 THE SPATIAL-PERCEPTUAL TAXONOMY 



Figure 6: 3D functional projection. Position: continuous correspondence to the projection axes; meaningful lines 
implicit interpolation (left), and surface explicit interpolation (right); shape: not given/chosen; color: none, (b) 
Star Coordinates 2D projection of 8-dimensional data. Position: continuous correspondence to the projection axes; 
shape: none; color: discrete correspondence to selections over axis D^. 


tion can be seen as a special case of projection, where 
the projection function is unknown; instead, the data 
positioning derives from the observed phenomenon, as 
for volume rendering and geographical charts. 

In reproduction, similarly to projections, data are 
mapped to positional marks that, via interpolation, can 
compose lines, areas, surfaces or volumes - compare 
Figures l^a) and[^a). Differently from projections, the 
positional reference (e.g., axes or background) is op¬ 
tional - see Figure l^a) - and, usually, it is assumed that 
the graphical items are embedded in a Euclidean space. 

From the expressiveness point of view, spatialization 
is the most important component of visualizations, pro¬ 
viding both direct and derived perceptions. Direct per¬ 
ceptions include differentiation (natural for space, no 
positional mapping is required) and correspondence (a 
positional mapping is provided, as for projection and 
sequencing). Derived perceptions include arrangement 
(as for structure exposition) and/or meaning (as for pro¬ 
jection and reproduction, which interpolate the points 
in space) occurring in parallel to other perceptions. 
Generally speaking, in visualization spatial design, the 
unique user decision, besides the spatialization method, 
is whether or not a positional reference will be used for 
correspondence. 

3.2 Shape 

We have argued so far that a limited number of spatial¬ 
ization procedures is at the core of visualization tech¬ 
niques, and that these procedures dictate the positional 
pre-attentive stimulus. Nevertheless, after spatializing 
the data, one still needs to decide how shape and color 
will compose the visualization. Hence, in this and in the 


following section we investigate how shape and color 
define visual perceptions for data interpretation - as in¬ 
troduced in Section [2^ In particular, the Shape stimu¬ 
lus embraces the largest number of possibilities for vi¬ 
sual perception: Correspondence, Differentiation, Con¬ 
nectivity and/or Meaning. 

• Correspondence: discrete or continuous, each notice¬ 
able shape has a specific correspondence in a shape map¬ 
ping. If no mapping is given, the intuitive mapping 
“bigger size - higher magnitude” is typically assumed. 
Figure [^exemplifies the discrete (a) and the continuous 
cases (b); 

• Differentiation: the displayed shapes simply discrim¬ 
inate the items for further interpretation, as in Figures 
[g:a),[3a) andma); 

• Connectivity: line segments that denote connectivity 
between graphical items as, for example, in the Parallel 
Coordinates, in node-link graph visualization (illustrated 
in Figure Qb)), and in the visualization in Figure [TO^a); 

• Meaning: shapes such as arrows, faces or other com¬ 
plex formats (e.g. text) carry meaning whose interpreta¬ 
tion relies on user knowledge, experience and culture, as 
depicted in Figures j^b) andfTO^b). 

At the border line between shape and position, shapes 
(arrows, crosses, triangles, faces, borders, etc.) are con¬ 
sidered part of the visualization design only if they were 
explicitly selected to integrate it. Shapes not explic¬ 
itly selected are in fact positional marks that may, via 
implicit or explicit interpolation, constitute lines, areas, 
surfaces or volumes, possibly with a certain complexity 
level that indirectly defines positional meaning. 
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4 ANALYTICAL EXAMPLES AND MULTIPLE SPATIALIZATIONS 



Figure 7: (a) Rendered dataset reproduction. Position: the set of reproduced positional marks compose a mean¬ 
ingful volume via explicit interpolation of the points; shape: not given/chosen; color: continuous correspondence, 
(b) Geographical map reproduction. Position: correspondence to the background map used for reproduction (the 
data positioning is known beforehand); shape: differentiation (large dots), and meaningful airport and road identi¬ 
fiers; color: discrete differentiation, and meaning following the knowledge that water is blue, (a) reproduced with 
permission granted by S.G. Eick. 


3.3 Color 

After applying a spatialization procedure, which leads to 
positional cues to perceive information, and after choos¬ 
ing shape expressivity to convey additional meaning, 
color is the third pre-attentive stimulus to be considered. 
Color conveys information through visual perceptions of 
Correspondence, Differentiation and/or Meaning: 

• Correspondence: discrete or continuous. In the dis¬ 
crete case, each noticeable color defines a correspon¬ 
dence to a color mapping (see Figurea)). In the con¬ 
tinuous case, the variation of tones maps to a continuous 
range of values, as shown in Figure [T0|^b). 

• Differentiation: colors bear no specific correspon¬ 
dence, they just depict an idea of equality (or inequal¬ 
ity) of graphical entities, as it may be observed in the 
examples shown in Figures |^b) and[^b); 

• Meaning: the displayed colors carry meaning. Exam¬ 
ples include specific colors, e.g. red for alert, and spe¬ 
cific materials resemblance (as in some textured color¬ 
ings). The comprehension depends on the knowledge, 
experience and culture of the user. 

The Spatial-Perceptual Taxonomy is based on three 
criteria for classifying visualizations: space, shape and 
color. The set of these features defines different refine¬ 
ment perspectives for classification: only spatialization, 
only shape, only color and the combinations of these as¬ 
pects. In the next sections, considering the possibility 
of multiple cycles of spatializations, we deepen into the 
notions of our taxonomy by defining its space of pos¬ 
sibilities (the Spatial-Perceptual Design Space) and by 


defining a model for navigating this space (the Visual¬ 
ization Machine). 

3.4 The Taxonomy Formation Hierarchy 

The proposed taxonomy classifies visualization tech¬ 
niques considering criteria that derive from the very con¬ 
stitution of the techniques. Hence, such criteria (spatial¬ 
ization, shape and color) are constituted by classes that 
reflect formation aspects. In our classification, a given 
technique falls within our taxonomy as an ensemble of 
factors that personify a constitutional categorization. 

Due to its descriptive - rather than only classifica- 
tory - properties and due to its number of criteria, the 
Spatial-Perceptual Taxonomy comes to a set of possibil¬ 
ities whose cardinality does not permit a readable enu¬ 
meration of its classes, either in a tree or in a tabular for¬ 
mat. For this reason, in figure we present the forma¬ 
tion hierarchy for our taxonomy. This formation scheme 
permits to envision the classes that constitute our classi¬ 
fication scheme via a top-down composition. This com¬ 
position corresponds to the criteria and to the classes that 
compose our taxonomical organization. 

4 Analytical examples and multiple 
spatializations 

4.1 Analytical examples 

Following, we illustrate our taxonomy by inspecting 
the components of two typical visualization techniques. 
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4 ANALYTICAL EXAMPLES AND MULTIPLE SPATIALIZATIONS 



Figure 8: (a) Projection of classified items. Position: continuous correspondence to the projection axes; shape: 
discrete correspondence, and differentiation (selection square); color: none, (b) Chernoff faces projection. Position: 
continuous correspondence to the projection axes, and discrete correspondence to the features mapped to the human 
face; shape: continuous correspondence (size and curvature); color: none. 


First, let us consider a classical pie chart - see Figure 
\V2\ - along with a fictitious dataset. For this example, 
the visualization design starts by adopting a circular se¬ 
quential spatialization along with a positional mapping 
of meaningful shapes (labels). The labels are used to 
state correspondences for each chart position. In a sec¬ 
ond step, shape (area) correspondence is applied to pro¬ 
vide extra encoding. The result exhibits slices whose 
sizes are proportional to the values of attribute X. As 
the last step, a discrete coloring is applied for further dif¬ 
ferentiation. The pie chart is an intuitive and straightfor¬ 
ward visualization design. For this reason, one tends to 
see it as a monolithic visualization, missing its compo¬ 
nents. Nevertheless, identifying such components may 
provide clues for new designs or to exploit design varia¬ 
tions. 

In a second example, the Parallel Coordinates tech¬ 
nique is used to illustrate the application of multiple 
spatialization procedures. We consider a hypothetical 
dataset with four-attribute (W, X, Y and Z) records, 
where attribute y is a classification attribute. To start, 
a sequential positioning is defined for the names of the 
attributes. The low dimensionality enables having a po¬ 
sitional map where the names of the attributes go along 
with the initial visualization. Each vertical position cor¬ 
responds to a specific attribute name. In the second step, 
the values of each attribute are projected vertically hav¬ 
ing axes as positional maps. This second spatialization 
cycle benefits from the empty space in the display area. 
Note that the spatializations are integrated so that the 
items placed in the first cycle (attribute names) become 


a positional reference to the items placed in the second 
cycle (projected attribute values). In the next step of the 
design, shapes (line segments) stating connectivity are 
employed in order to express which data items are inter¬ 
related according to the dataset records. The final step 
uses color encoding in order to differentiate the poly¬ 
lines. 

4.2 Multiple spatializations 

As exemplified in Figure visualizations may show 
disjoint regions, each with a different spatialization strat¬ 
egy. Another example can be seen in Figure [T4|^a) for 
example, where it shows a grid in which star glyphs are 
spatialized according to a projection of two attributes. 
Figure [T4|^b) focuses on one of these glyphs showing the 
available space within the glyph. Figure [T4|^c) shows 
that, within each glyph, the remaining attributes are po¬ 
sitioned based on a Sequential spatialization. Finally, 
Figure [^d) focuses on a particular stick whose size 
corresponds to the magnitude of the third attribute of the 
(hypothetical) j-ih item. 

Similarly to the examples shown in Figures[T^and[T4l 
multiple spatialization cycles are applied in techniques 
such as Dimensional Stacking |[32ll . Worlds-within- 
Worlds lHH, Circle Segments 111, Pixel Bar Charts 
ll28l and in many of the so-called iconic techniques. 
Multiple spatialization cycles define hybrid approaches 
that comprise a vast number of the techniques found 
in the visualization literature. In such compositions, 
pre-attention depends on how one focuses on the 
visualization. 
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5 THE SPATIAL-PERCEPTUAL DESIGN SPACE 



Figure 9: (a) Table Lens sequencing. Position: discrete correspondence to the axis labeled with attribute names in 
sequential positioning (horizontally), and discrete correspondence to the itens in sequential ordered positioning of 
the 5th column (vertically); shape: line width correspondence (all columns), and differentiation (on the 5th column, 
shapes indicate selection); color: discrete correspondence (colors correspond to selectors), (b) Star Glyphs projec¬ 
tion. Position: correspondence to the window as an Euclidean projection plane, and correspondence through the 
circular sequencing of the inner sticks at each glyph; shape: differentiation determined by the contour around each 
glyph, and proportional correspondence for the inner sticks (length); color: discrete correspondence to selectors, 
(b) created with XmdvTool USD. 


Multiple spatialization cycles is a key factor for the 
diversity in visualization design. Integrated spatializa¬ 
tion cycles allow improved space utilization and result in 
more complex techniques. In the next sections, we show 
that such understanding, coupled with our taxonomical 
system, can provide guidances on new thoughts for vi¬ 
sualization. Table [^presents similar analysis for several 
visualization techniques widely referenced in the litera¬ 
ture. 


The case studies observed in table |2] illustrate how the 
Spatial-Perceptual Taxonomy can analyze the constitu¬ 
tion of several visualization techniques. Notably, one 
can perceive that the use of multiple (and possibly het¬ 
erogeneous) spatializations are common, not to say nec¬ 
essary, in the visualization design. It is also possible to 
see that shape is not always explored, perhaps because of 
spatial limits. Color, in turn, can always be used with¬ 
out overloading the design framework. Each set of con¬ 
figurations in table can be understood as a complete 
characterization according to our taxonomy. Moreover, 
as pointed in section the characterization that follows 
from our taxonomy can also be seen partially, consider¬ 
ing for example, only classes based on spatialization or, 
for example, classes that arise from the combinations of 
shape and/or color. 


5 The Spatial-Perceptual Design 
Space 


Based on the Visual Expression Process - section 2.3 


it is possible to conceive a Perceptual Space, as illus¬ 
trated in Figure [^a), that describes the expressiveness 
of visualization techniques. The axes of this space cor¬ 
respond to the available possibilities of the basic visu¬ 
alization elements. As so, a visualization technique is 
defined in terms of its parameters regarding the choice 
of position, shape and color, each one cast to a subset 
of the visual perceptions introduced in Section [23] cor¬ 


respondence, differentiation, connectivity, arrangement 
and meaning. 

This idea may be further refined under the Spatial- 
Perceptual Taxonomy introduced in Section which 
supports the definition of a design space for the vi¬ 
sualization techniques. The Spatial-Perceptual Design 
Space, illustrated in Figure [TS^b), assumes that posi¬ 
tional perception is dictated by the spatialization pro¬ 
cesses, as structured in our taxonomy. In this design 
space, the positional dimension becomes the spatializa¬ 
tion dimension, according to how we describe this con¬ 
cept in Section 


Finally, in a third step, we consider the possibility 
of multiple spatialization cycles, as discussed in Sec¬ 
tion]?^ to depict the complete spatial-perceptual design 
space. The design process now becomes a sequence of 
space filling cycles that follows the space/perception de¬ 
sign and proceeds until all the available space is occu- 
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6 INTERACTION TECHNIQUES 



Figure 10: (a) Globe-map-based reproduction. Position: the reproduced points state continuous correspondence 
to Earth globe; shape: connectivity (curved lines), and correspondence to pillar size; color: discrete correspon¬ 
dence. (b) Chemical structure reproduction. Position: the reproduced points state correspondence to the enclosing 
parallelepiped, and meaning according to the chemical structure achieved via interpolation of the points; shape: 
not given/chosen (explicit interpolation); color: continuous correspondence. Images reproduced with permission 
granted by Stephen G. Eick. 


pied. In Figure [T5]^c) we present the Spatial-Perceptual 
Design Space for techniques whose conception adopts 
multiple spatialization cycles. 

While the Spatial-Perceptual Taxonomy identifies 
the categories of visualizations features, the Spatial- 
Perceptual Design Space presents this notion in an in¬ 
tuitive Euclidean space representation, where each point 
addresses a possible class. In this line, our motivation 
is to make clear what can be done in terms of the visu¬ 
alization design and how the corresponding possibilities 
can be organized from a perceptual-cognitive perspec¬ 
tive. The overall idea follows two steps: 

1. Make choices for spatialization, shape and color in 
terms of correspondence, differentiation, connec¬ 
tivity, arrangement and meaning; 

2. Iterate through multiple cycles while there is avail¬ 
able space. 

In the next sections we also observe that, for com¬ 
plete visualization systems (data management + visual¬ 
ization + interaction), other two steps are necessary: pre¬ 
exhibition data processing and interaction. 

6 Interaction Techniques 

The scope that we have chosen to explore in this work 
is the definition of a design space oriented to visual ex¬ 
pressivity. Accordingly, we have focused on the visual 


appeal of sole data visualization techniques, rather than 
on the operational features of a complete visualization 
system (data management + visualization + interaction). 

Unlike previous works, interaction is not a component 
of our theory, rather, it rises as a natural product of the 
proposed concepts. In this section, we clarify the role 
of interaction techniques under the light of the proposed 
ideas. However, this work does not intend to determine 
how interaction can be used in the visualization design: 
our aim is only to determine where does interaction fit 
our theory. Interaction is a much wider field of research, 
thus we believe that separating interaction from visual¬ 
ization helps to keep the conceptual model clearer. Re¬ 
stricting the analysis to the domain of techniques for data 
visualization, we establish two conditions to identify an 
interaction technique: 

1. An interaction technique must enable a user to de¬ 
fine/redefine the visualization by modifying pre- 
attentive stimuli; 

2. An interaction technique, with appropriate adapta¬ 
tions, must be applicable to any visualization tech¬ 
nique, in an efficient way or not. 

The first condition is a direct consequence of the as¬ 
sumption that interaction techniques changes the state 
of a computational application. In the case of a visu¬ 
alization scene, its basic components (the pre-attentive 
stimuli) must be altered. The second condition derives 
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7 THE VISUALIZATION MACHINE MODEL 



from the need to have a well-defined, yet general, con¬ 
cept. Therefore, interaction techniques, then, must be 
applicable to any visualization technique, even if not ef¬ 
ficiently. In the current literature, we identify the follow¬ 
ing interaction paradigms satisfying our criteria: 

• Parametric: the visualization is indirectly redefined 
through mechanisms that reflect on new parameters 
for position, shape or color; visually (e.g., scroll- 
bar) or textually (e.g., type-in). An example is 
the Hierarchical Brushing mechanism described by 
Ewdi etal lIT^ : 

• View transformation: this interaction allows chang¬ 
ing shape (size) and position of a visual scene 
through scale, rotation, translation and/or zoom, as 
in FastmapDB ifTSl : 

• Filtering: a user can visually select a subset 
of items that will be promptly differentiated for 
user perception by changing pre-attentive proper¬ 
ties such as color (brushing) and shape (selection 
contour). Detailed studies are presented by Martin 
and Ward 1371; 

• Details-on-demand: detailed information about the 
data that generated a particular visual entity can be 
retrieved for exhibition. As an example, we refer to 
the interaction used in the Table Lens visualization 
technique - it allows retrieving the data that orig¬ 
inated a given graphical item and present it using 
textual (shape) visual patterns; 


• Distortion: allows visualizations to be projected 
so that different perspectives (positions) can be 
observed and defined simultaneously. Classical 
examples are the Perspective Wall l36l and the 
Fish-eye Views fl31 . 

The well-known Link & Brush (co-plots) technique 
does not satisfy the conditions to be considered an in¬ 
teraction technique. Link & Brush is more like a de¬ 
sign dependent automation. It is based on the possibil¬ 
ity of integrating multiple spatializations so that inter¬ 
action tasks applied to one of the spatializations reflect 
on the others. One could generalize Link & Brush and 
think of Link & View Transformation (e.g, synchronized 
panning). Link & Parameters (e.g, parameters multicas¬ 
ting), Link & Distort (e.g., simultaneous perspective al¬ 
teration), and so forth. 


7 The Visualization Machine model 


Facing visualizations from the perspective of the pro¬ 
posed theory allows conceiving an ideal generalized 
visualization mechanism. This is illustrated in Figure 


16 which shows a model integrating the concepts 


described so far. 


The Visualization Machine, described next, is not a 
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7 THE VISUALIZATION MACHINE MODEL 
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Figure 12: Components of a Pie Chart visualization. 


finalized scheme, but a seminal idea, a new way of 
thinking. Its principle is the reduction of the visualiza¬ 
tion design in such a way that, theoretically, it could be 
made mechanically. Its description personifies both the 
Spatial-Perceptual Taxonomy and the Spatial-Perceptual 
Design Space. The framework delineates a model for 
navigating through the possibilities of design predicted 
by our theory. In this context, the frame over which the 
Visualization Machine evolves is in the format of a hi¬ 
erarchy of possibilities. The branches of these hierarchy 
lead to classifications based on spatialization, shape and 
color. 

A top-down model 

Our model states that a visualization is achieved by 
carrying out a sequence of steps that starts with the 
spatialization of a set of data items. The initial spa¬ 
tialization then undergoes shape and color encodings 
and may be followed by other spatialization cycles. 
In the model illustrated in Figure each step of the 
visualization design defines a decision point (black 
circles in the figure) that will iteratively generate a 
visualization that conforms to the choices of the user. 
A careful look reveals that the Visualization Machine 
is a model that supports user navigation through the 
space defined by the Spatial-Perceptual Design Space 
presented in section]^ 

A pre-exhibition data processing step complements 
the overall design process. The pre-exhibition data 
processing is not in the main scope of this work, 
which is the definition of a design space oriented to 
visual expressivity. However, as the pre-exhibition data 
processing is needed for many visualization systems, we 


have added it to our conceptual model. This processing 
step occurs before the spatialization, when data are 
usually processed to enable better management and 
mapping. The step is executed using database support 
and includes operations such as the reduction of the 
number of data items, selection of attributes, dimen¬ 
sionality reduction, computing summaries, classify data 
items, perform data mining operations, to name a few. 
In many domains, pre-exhibition data processing is a 
necessary step before conceiving the visualization. 

Pools of parameters 

In our systematization, the steps for spatialization, 
shape and color encodings are assisted, respectively, 
by pools of spatialization methods, pools of shape 
expression methods and pools of color expression meth¬ 
ods. The pools represent sets of known methods that 
can be used to conceive patterns for visual ensembles. 
User intervention permits to use these pools to define 
parameters for each of the steps, from pre-exhibition 
data processing to coloring, allowing the user to choose 
the procedures and the patterns that best match her/his 
needs. Along the text we have shown several examples 
of design that apply to well-known visualization tech¬ 
niques. The constituents of such designs exemplify the 
repertory of the pools of parameters that we propose. 

Supervision/Intervention 

The choice of parameters defined via user intervention 
demands supervision, both automatic and user provided. 
A supervision module is depicted at the left-hand side 
of the schema in Figure Supervision is aimed at 
validating and verifying the parameters for each step 
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7 THE VISUALIZATION MACHINE MODEL 
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Figure 13: Components of a Parallel Coordinates visualization. 


of the design process in order to determine what are 
the choices that can be applied in the current and in 
the subsequent steps. In the current step, supervision is 
supposed to consider the current user choice in order to 
select the methods that can be properly used from the 
current pool of parameters. For the subsequent steps, 
supervision is supposed to filter out choices that might 
lead to bad designs. For example, due to the limited 
space in conventional displays, it is not reasonable to 
choose a sequential spatialization of a million items 
from a dataset and then to choose a shape correspon¬ 
dence in the next step. More important, the supervision 
module is also cast to collect data about the spatial¬ 
ization cycles. This is necessary in order to monitor 
the available space to be used by further spatialization 
cycles, and to detect and offer possibilities to integrate 
multiple spatializations. Such integration is essential 
for the conception of more complex techniques that 
benefit from multiple spatializations. For example, it 
can promote link-like automation, so that interaction pa¬ 
rameters are multi-cast to more than one spatialization; 
or it can promote coordinated spatializations, so that the 
items in different display areas follow the same ordering. 


Interaction 

The definition of interaction introduced in Section [6] 
states that any interaction technique fits any visualiza¬ 
tion. Thus, any interaction technique should be readily 
applicable in the Visualization Machine model. Of 
course, the availability and adaptation of each inter¬ 
action paradigm will follow the nature of the specific 
parameters (position, shape and color) chosen for the 
design. Interaction efficiency reflects the integration of 
all the selected components. 

Evaluation 

The parameter-based top-down Visualization Machine 
model ensures a high level of freedom in combining 
multiple encoding components. Such combinations can 
be efficient, reasonable or even catastrophic, depending 
on the goals of the user who defines the visualization 
setting. Therefore, the model also embodies a repository 
of evaluations (lower left in the diagram). Once a user 
defines a visualization setting and is able to use it, 
she/he can evaluate it according to her/his goals. Each 
evaluation is stored at the repository module that joins 
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7 THE VISUALIZATION MACHINE MODEL 
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Figure 14: Two spatialization cycles applied in generating a visualization, (a) Projection of star glyphs, (b) Focus 
on a particular Star Glyph, (c) Sequencing within the glyph, (d) Attribute information as a shape correspondence. 


the information from the dataset being analyzed, from 
the interaction techniques and from the parameters 
that define the visualization setting. The information 
becomes available to the supervision module for user 
assistance and validation, and for automatic parameter 
definition during subsequent system usage. 

An expanding self evaluation/learning system 

The Visualization Machine model is structured as a 
system that can create visualizations based on sets of 
design parameters. It can be considered an environment 
that provides and manipulates aspects of the data 
visualization science. Under this perspective, visualiza¬ 
tion research may be seen as a discipline that tackles 
discovery and empirical evaluation of spatialization 
and expression methods that fit the proposed model. 
New methods would be incrementally incorporated and 
established in the model, at the repository pools. In 
this scenario, it is possible to think of an incremental 
visualization environment in which users would apply 
parameters previously conceived by specialist designers. 
This possibility contrasts with the current paradigm, 
in which visualizations are limited to implementations 
following specific, rigid designs. 

The self evaluating characteristic of the model grants it 
to be a learning system that adapts to different user pro¬ 
files or that converges towards a universal visualization 
tool. 

A Conceptual Proposition 

The Visualization Machine is idealized as a tool to en¬ 
able browsing collections of methods. It is envisioned 
as a composing process that aims at expressing visual 
perceptions of correspondence, differentiation, connec¬ 
tivity, arrangement and meaning using space, shape and 
color. At the same time that the user would be able 


to browse and combine collections of methods, the ma¬ 
chine would monitor possible combinations of methods 
by suggesting previously successful configurations and 
preventing non-prospective ones. This course of concep¬ 
tion is conceptual and plenary resulting from the con¬ 
sideration of our theory. Not surprisingly, its realiza¬ 
tion raises technical challenges. It is necessary a clear 
interface for universally accommodating methods (es¬ 
pecially interaction methods) providing an expanding 
framework, each time more complete. It is also desir¬ 
able a well-defined standard for recording the configura¬ 
tion sets of the machine and the evaluation of the users 
in terms of the data interpretation. 

Together with the Spatial-Perceptual Taxonomy and 
Design Space, the Visualization Machine defines a set 
of concepts for an alternative understanding of the data 
visualization design. It is not a complete project for de¬ 
velopment but, rather, it is a “conceptual proposition” 
intended to propel new perspectives for visualization. Its 
principle is to consider visualizations as combinations of 
a repetitively employed and limited (though not small) 
set of methods and techniques categorized in terms of 
their nature (space, shape and color) and expressivity 
(visual perceptions). It is supposed to be a new frame¬ 
work where new implementations can be accommodated 
and combined with already existing modules. We be¬ 
lieve this is the overall line through which visualization 
science will evolve, probably reaching a unified conver¬ 
gence. 

Despite the idealized nature of the model, which hides 
many intricacies, we observe that its completeness and 
coherence provide a starting point to accomplish such 
a tool or to conceive a framework on a similar basis. 
Following we describe our design process through two 
examples. 
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7 THE VISUALIZATION MACHINE MODEL 



Figure 15: Design spaces, (a) The Perceptual Space with dimensions position, shape and color. The domains are 
subsets of the visual perceptions that we have identified, (b) The Spatial-Perceptual Design Space, where Position 
is dictated by the spatialization processes, (c) The complete Spatial-Perceptual Design Space, which includes 
multiple spatialization cycles. 


Star Glyphs 

As a first example, we go through the design process of 
the classic Star Glyphs technique, illustrated in Figure 
[HI The design conception starts by adopting a spatial 
projection according to attributes, say, 1 and 2; no 
shape; no color. These first decisions define a complete 
cycle over the Visualization Machine logic. Thereafter, 
a second cycle takes place. For each projected data 
item, and respecting the remaining empty space, we 
apply a sequential circular spatialization of attributes 
3 to 7; for shape encoding, we opt for correspondence 
and choose sticks with proportional shape; we opt for 
differentiation connecting the outer extremities and 
determining the contour of the sticks; for color, we can 
benefit from differentiation, having the highest value in 
each dimension emphasized in red. Finally, having two 
cycles of design, we choose to add interaction to the 


first cycle adding filtering over the projected items. 

Coordinated Parallel Bar Charts 

In this example (see Figure [^, we design a varia¬ 
tion of the well-known Parallel Coordinates technique 
called Coordinated Parallel Bar Charts. Initially we 
consider a semantically-rich hypothetical dataset with 
four-attribute records (gross domestic product, popula¬ 
tion, per capita income and country name). First, like 
in the Parallel Coordinates technique, we apply a se¬ 
quential positioning of the attributes; meaningful shapes 
(labels) and no color. In a second cycle, the values of 
each attribute are projected vertically, having the high¬ 
est values at the lower part of the axes. At this point 
we observe that it is possible to benefit from existing 
correspondences using shape proportionality. This deci¬ 
sion creates the appearance of a sequence of bar charts 
presentation. In the last steps, we choose relationship 
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Figure 16: The Visualization Machine model for general visualization design. 


via shape encoding (polylines) and color differentiation 
much like in the classic Parallel Coordinates. The fi¬ 
nal result is a technique that, besides showing the values 
of the attributes through positional correspondence, also 
stresses the distortions that can be observed in the do¬ 
main of each attribute. 


8 Conclusions 

In this paper we have introduced a new comprehen¬ 
sive perspective for visualization design. To do so, ini¬ 
tially we identified the Visual Expression Process in or¬ 
der to delineate a new strategy for analysis. This ob¬ 
servation allowed us to concentrate on the expressive¬ 
ness of the visualizations in order to identify their el¬ 


ements. The elements are the basis to conceive the 
Spatial-Perceptual Taxonomy, which considers visual¬ 
izations as sets of components that afford a limited num¬ 
ber of visual perceptions. This investigation led us to the 
Spatial-Perceptual Design Space, which aggregates the 
presented ideas in a single conception. For complete¬ 
ness, we have also discussed how interaction techniques 
fit into our theory. The proposed taxonomy and de¬ 
sign space were finally integrated into a design scheme 
named Visualization Machine Model. Along the text, 
to validate our observations, we analytically reviewed a 
number of designs according to the proposed ideas. 

The proposed work is centered on how users perceive 
visualizations, rather than on which patterns are used to 
build a given visualization. Unlike former approaches 
that depart from the set of available visual patterns, we 
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Figure 17: Design process for classic Star Glyphs technique according to the Visualization Machine model. 


ground our ideas on the set of visual perceptions, in or¬ 
der to choose approaches for position, shape and color 
encoding. Our approach brings designers closer to the 
expressive characteristics of visual ensembles. We be¬ 
lieve that this theorization can promote a more intuitive 
understanding of the design process, fostering further re¬ 
search toward a more precise and comprehensive design 
science concerning visualization techniques. 

This work introduces straight future research lines. 
First, the Visualization Machine is a conceptual proposi¬ 
tion to illustrate the usability of our theory. Its feasibility 
and complexity must be traced and compared to other 
visualization libraries and packages. Another line of re¬ 
search concerns the topic of animation, which applies to 
all the features studied in this work: space, shape and 
color. The study of animation requires an ample under¬ 
standing of its implications and of the intricacies of its 


elaboration. Finally, a similar study must be carried out 
at the level of visualization systems so that, expanding 
our line of analysis beyond visual design, the structuring 
and construction of complex visualization environments 
can be envisioned with animation, advanced interaction 
and multiple coordinated views. 
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Table 1: previous work on conceptual frameworks for visualization. 


Part(a) - Analytical approaches 

Author 

Contribution 

Berlin O 

Pioneer in stating that there is a limited set of components that define visual structures: marks and 
the properties these marks . 

Cleveland and 

McGill (m 

Extends the work by Berlin defining a method for automatic design of presentations based on the 
evaluation of graphical patterns. 

Mackinlay 1^ 

Eollowing Cleveland and McGill, Mackinlay evaluates graphical patterns to determine the layout 
directives for data visualization. Adds connection and enclosure “[] ” concepts. 

Card, Mackinlay 

and Shneiderman 

m 

Compiles previous works to introduce a general design space oriented to the visual patterns and to 
the space substrate. 

Part(b) - Taxonomical approaches 

Taxonomy 

Criteria 

By Keim 1^ 

ID, 2D, multiD, text/web, 

hierarchies/graphs and 

algorithm/software 

standard 2D/3D, geometrical, 
iconic, dense pixel and stacked 

standard, projection, filtering, 

zoom, distortion and 

link&brush 

Task by Data Type 
by Shneiderman 

l?7l 

One, two, three, multi-dimensional, tree and 

network 

overview, zoom, filter, details-on-demand, 
relate, history and extract 

Data State 

Reference Model 

by Chi QOl 

Stages of value, analytical abstraction, 

visualization abstraction and view 

transformation operators of data, visualization 
and visual mapping 

Lohse et al. 

Rectilinear cartesian coordinate graphs, bar graphs, line graphs, matrix diagrams, trilinear charts, 
response surfaces, topographic charts and conversion scales 

Taxonomy draft by 
Grinstein ll^ 

Geometric, symbolic, 2D/3D and static/dynamic 

browsing, sampling, indirect, associative and 
system oriented 

Digital 

Visualization 

Space by Bugajska 

om 

Object (a graphic representing concepts), context (a graphic space representing relations between 
elements), order (spatial arrangement in the graphic space), goals (structure, organization, 
appearance) and tasks (overview, zoom, filter, detail-on-demand, relate, history, and extract) 

Externalizations by 
Tweedie |[50l 

Purpose (display structures, view relations, database queries, ...), data types (values, metadata, 
structures, derived values), representation (spreadsheets, graphs, retinal variables, structures, 
multiple views, multi scale and distorted views, ...), interactivity (direct/indirect) and I/O 
representation 
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Table 2: Examples of spatial-perceptual analyses considering common settings for classical techniques. 


Visualization Technique 

Spatialization 

Shape 

Color 

Prospective 

Interaction 

Chernoff Faces 13 

Projection, Sequencing 

Differentiation, 

Correspondence 

- 

Eiltering 

Dimensional Stacking ll^ 

Multiple Projection 

- 

Differentiation 

Eiltering 

Parallel Coordinates 1(2^ 

Sequencing, Multiple Projection 

Connectivity 

Differentiation 

Eiltering 

Scatter Plots IT^ 

Multiple Projection 

- 

Differentiation 

Eiltering 

Star Coordinates 

Projection 

- 

Differentiation 

Eiltering, 

View transformation 

Stick Figures 

Projection, Multiple Sequencing 

Differentiation, 

Correspondence 

Differentiation 

Eiltering 

Worlds-within-Worlds ifT^ 

Multiple Projection 

- 

Differentiation 

View transformation 

Parallel Coordinates/Star 

Glyphs 1141 

Multiple Sequencing, 

Multiple Projection 

Connectivity 

Correspondence 

Eiltering, parametric 

Flow Map Layout |[^ 

Projection 

Correspondence, 

Connectivity 

Correspondence 

Details-on-demand 

Bar Chart 

Projection 

Correspondence 

Correspondence 

Eiltering, Parametric 

Pixel Bar Charts 1^ 

Projection, Multiple Sequencing 

Correspondence 

Correspondence 

Eiltering, Parametric 

Circle Segments H) 

Multiple Sequencing 

Differentiation 

Correspondence 

Eiltering, 

Details-on-demand 

Pixel Oriented Techniques by 
Keirnim 

Multiple Sequencing 

- 

Correspondence 

Eiltering, Parametric, 

Details-on-demand 

Pie Chart 

Sequencing 

Correspondence 

Differentiation 

Entering, Parametric 

Table Lens 1411 

Sequencing, 

Multiple Sequencing 

Correspondence 

Differentiation 

Eiltering, 

Details-on-demand 

InterRing 15^ 

Structure Exposition 

Correspondence 

Correspondence 

View transformation, 

Details-on-demand 

Cone Tree 143 

Structure Exposition 

Connectivity 

Differentiation 

View transformation, 

Details-on-demand 

Hyperbolic Tree 1^ 

Structure Exposition 

Connectivity 

Differentiation 

View transformation, 

Details-on-demand 

Treemaps l46l 

Structure Exposition 

Correspondence 

Differentiation 

Eiltering, 

Details-on-demand 

Voronoi Tree-maps |2l 

Structure Exposition 

Correspondence 

Correspondence 

Eiltering, 

Details-on-demand 

Geographical Maps 

Reproduction with referential 

Differentiation, 

Meaning 

Differentiation, 

Correspondence 

View transformation, 

Details-on-demand 

Vector Visualization 

Reproduction 

Meaning, 

Correspondence 

Correspondence 

View transformation 

Direct Volume Rendering 153 

Reproduction 

Not given/chosen 

(explicit interpolation) 

Correspondence 

View transformation 
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